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For one-sample level a tests ipm based on independent ob- 
servations Xi, . . . , Xjn, we prove an asymptotic formula for the 
^1 ' actual level of the test rejecting if at least one of the tests 

, tpm ■ ■ ■ ,il}n+k would reject. For fc = 1 and usual tests at usual 

04 ' levels a, the result is approximately summarized by the title of 

this paper. 

^ ' Our method of proof, relying on some second order asymp- 

totic statistics as developed by Pfanzagl and Wefelmeyer, might 
also be useful for proper sequential analysis. A simple and ele- 
mentary alternative proof is given for fc = 1 in the special case 
of the Gauss test. 

H 

^ . 1. Main result and examples. 

1.1. Introduction and main result. For a given one-sample testing problem 
and for every sample size m, let tpm be a test of level a, based on the m 
cp ■ independent observations Xi, . . . ,Xm- Suppose that initially n observation 

were planned, but that these do not lead to the desired rejection of the 
i/S hypothesis. Then some experimenters might be tempted to collect up to k 

further observations Xn+i, . . . , Xn+k, calculating after each the test based 
on the accumulated observations, and to declare in effect a rejection of the 
hypothesis at level a if ipm = 1 for some m G {n, . . . ,n + k}. This would 
. of course be wrong, but by how much? Surprisingly this question, known 

in the statistical literature at least since the publications of Feller [3] and 



in 
d 



o 



Robbins [17j, is usually not addressed in textbooks or treatises of statistics. 



^ ' see Subsection 11.21 below 

• The title of the present paper gives a somewhat rough but easy to grasp 

answer for the simplest case of = 1 , approximately valid for common values 
of a and rather general one-sample tests based on asymptotically normal 
test statistics. Theorem 1 1 . 1 1 b elow gives a mathematically precise answer also 
for general k. We may summarize its statistical meaning as follows: Even an 
apparently slight amount of optional stopping will usually inflate the nominal 
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level of a test by a serious amount, such as by about 10 per cent for n = 100 
and k = 1. 



In our formulation of Theorem 11.11 we think of non-randomized tests ipm 
based on upper test statistics with critical value zero, that is, ipm = 
(Tm > 0), using the indicator notation (statement) := 1 or according to 
whether "statement" is true or false. Thinking only of tests actually exhaust- 
ing a given level a, we essentially assume that this level is attained for at 
least one distribution from the hypothesis, simultaneously for all sufficiently 
large sample sizes. Theorem 11.11 refers to such a distribution, compare as- 
sumption (pP) below, where the above qualifier "essentially" has been made 
precise as " + o{l/^/r^)" . Unfortunately this assumption already excludes 
lattice cases like the binomial tests, for which any analogue of Theorem 11.11 
would presumably look more complicated. Now the test rejecting if at least 
one of the tests ipn, ■ ■ ■ ^i^n+k would reject is (max^tf„Tm > 0), and hence, 
with respect to a given distribution of Xi, its probability of rejecting is 
as defined in ^ below. Our regularity assumptions ([H])-© on the sequence 
(T„) are similar to those imposed by Pfanzagl and Wefelmeyer in their well- 



known treatise of second order asymptotic statistics, see in particular pj. 
Section 10.3], on which our result is based. In Subsection 12. II below we com- 
ment on some minor differences between these assumptions. Let $ and = $' 
denote distribution function and density of the standard normal distribution 
Nq and let us put 

h{a) := ^ («G]0,1[) 



We write := {{x,y) E : x y} for any set A and x+ := x V = 
max{x, 0} = (—a;)- for a; G M. Proofs of Theorem 11.11 and Lemmas 11.11 and 
11.21 are given in Section [21 see Subsections 12.31 12.41 and 12.51 We point out 
that Example 11.3.11 below contains an elementary direct proof, suitable for 
inclusion in standard statistics courses, of Theorem 1 1 . 1 1 in its simplest special 
case of the Gauss test with one optional observation, that is. A; = 1. 

Theorem 1.1. Let X be a measurable space, (X„)„gN « sequence of in- 
dependent and identically distributed X -valued random variables, a G ]0, 1[, 
and (t„)„gN o sequence of measurable functions tn '■ X"^ — > M such that the 
random variables 

Tn := t„(Xi,...,X„) (nGN) 

satisfy 

(1) P(T„>0) = « + o(^) (n^oo) 
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Let 

(2) an,k := P(maxT^ > 0), Pn,k — ^ - 1 

' m=n / ■ I ^ 



(n, A; e N) 



Assume that for n e N 



(3) T„ 



1 



1 



i=l 



+ 



/2(Xj, Xj ) 



/or some constants Ho, fJ^i £ I^; measurable functions /q, /i : A' — > M and 
/2 : A"^ — > and a sequence (i?n)neN o/ real-valued random variables with 

(4) E/o(Xi) = E/i(Xi) = E(/2(Xi,X2)|Xi) = 0, f2{Xi,X2) = f2{X2,X,) 

(5) E(/o(Xi))^ = 1, E|/o(Xi)|^ < oo, fo{Xi) has a non-lattice law 

(6) E|/i(Xi)|^/^ < oo, E|/2(Xi,X2)|^+'' < oo for some 5 > 



te 1 

(7) For every £> 0: suptF{\Rn\ > ^=^) = o{ 

t>i 



Then 

(8) Pn,k = 
and 

(9) Pn,fc 



/i(Q;) 



v^E7e(E/o(^^ 
e=i * ^ 1=1 



+ o 



(n ^ oo) 



For common levels a, we have h{a) ~ 1: 



> 0, k —>■ oo) 



Lemma 1.1. The function h is strictly decreasing with the asymptotic 
behaviour 



(10) h{a) 
and rounded values 



llog(i) (a^O) 
TT a 



a 


0.05 


0.025 


0.01 


0.005 


0.001 


0.0005 


h{a) 


0.82 


0.93 


1.06 


1.15 


1.34 


1.42 
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Taking /c = 1 in ([H]), we get 
:il) p„,i ~ ^V2^e(UX,)) (n^oo) 



So, assuming hip) ~ 1, the claim in the title of this paper approximately 
results when \/7j^¥.{Jq(Xi)^ ^ ^ 1 and n is sufficiently large. For the Gauss 

and t-tests in Examples II .3. II and II. 3.31 below, we have \/27r'E(^/o(Xi)^ = 1 

exactly. In theses two cases, from ( ITSj) below, one optional observation in- 
flates a by h[oi)V^^I^Jn per cent, two optional observation inflate a by 
/i(a;)171/i/n' per cent, etc. For general examples we note, using (j4]), ([5]) and 
E|y| < (EF2)1/2^ that y2FE(/o(Xi)) can be any strictly positive number 

< VStt'I (^E(^/o(Xi)^ ^ ^ = y^7r/2', so the accuracy of the claim in the title 
depends on -\/27r 'E(^/o(Xi)^^ being not too far from its value under /o(Xi) ~ 

No,i. In the exponential Example ll.3.21 we have A/27r'E(^/o(Xi)^^ = -\/27r' /e = 
0.92, so that in this case one optional observation inflates a by merely 
h{Q)^1l ^Jn per cent. 

Many test sequences i^n) in the literature can be written in the form 
il}n = {Tn > 0) with (Tn) admitting an expansion as in Theorem 11.11 This 
is in particular true, under appropriate regularity conditions, for one-sided 
tests based on one-dimensional components of minimum contrast estimators. 



see 



15l . pp. 395-396, Theorem 11.3.4] for a precise statement and references. 
In our examples in Subsection 11.31 below we can easily check all assumptions 
rather directly. 

We have to note here that our assumption (JTj) on the sequence of remain- 
ders (Rn) is slightly stronger than Pfanzagl and Wefelmeyer's 

(12) For every £>0: P(|i?„,| > e/v^) = o(l/v^) {n oo) 

Condition ([7]) appears to be just about what is needed in the proof of our 
crucial Lemma 12.11 below, since we allow k to be unbounded, see fl?Il) below. 
For bounded k, assumption (fT2l) would suffice. Condition should be easy 
to establish in any reasonable case, and we do this in Example 11.3.31 below 
by using the following simple fact. 

Lemma 1.2. Let (-Rn)neN be a sequence of real-valued random variables 
such that for some p G [1, C)o[ and uq E N the random variables 

(13) y; := \n-^Rn\'' 

with n > uq are uniformly integrable. Then ([7j) holds. 
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For a discussion of further minor differences between Pfanzagl and We- 
felmeyer's and our assumptions on (T„) see Subsection 12. II below. 

1.2. Various remarks. Reading this subsection is not logically necessary 
for understanding the rest of this paper. 

Under the assumptions of Theorem 11.11 one can easily show that T„ — 
Ho — (1/ ^/rl)J27=l foi^i) converges to zero in probability, so that — /iq 
converges in law to No,i, and hence, in view of ([I]), we must have 

(14) fio = -$-1(1 -a) 



The result of [l5|. Corollary 10.3.8], on which our proof of Theorem 11.11 will 
be based below, further includes a formula for /ii in terms of a, /o, /i, /2 and 
the law of Xi. 

The expectations occuring in formula (IHl) can be computed explicitly in 
some cases, see in particular Example 11.3.21 below and, more generally, . 



We always have E(X!i=i /o(-^i))+ ~ v 2~ for ^ ^ cc, see the end of the proof 



2n 

of Theorem [LH and E(ELi /o(^*))+ > E(/o(^i))+ by [l2|. Corollary 



1.3]. 

Relation iQ becomes false if the condition "fc/n —>■ 0" is replaced by "fc/n 
bounded", since for k/n constant and sufficiently large a contradiction to 
ttn,fc < 1 would result. 

As mentioned above, the problem of level inflation due to optional stopping 
is usually not addressed in textbooks or treatises of statistics. It was raised, 
perhaps for the first time in the literature, by Feller in 1940 in connection 
with apparently ill-conducted experiments concerning "extra-sensory percep- 
tion", see 0, pp. 286-294] and references therein. Robbins [it!, pp. 534-535] 
posed the problem of evaluating or bounding what we have called an,k, and 
stated without proof a bound in the case of the Gauss test. We are not aware 
of a continuation of that part of Robbins' work. Diaconis [3] comments criti- 
cally on Feller's paper, but not on the particular point of optional stopping. 



Among books known to the present author, Pfanzagl's [IJ, p. 127)] is unique 
in stressing and demonstrating the problem, albeit only by a simulation, and 
unfortunately obscured by the additional deliberate mistake of choosing be- 
tween two valid test for each sample size. To our surprise, we did not find 
any statistical textbook treating the problem more systematically. 

Theorem II. II can be read as addressing an improper sequential analysis. Its 
technical basis however, namely the consideration of statistics with stochas- 
tic expansion, Pfanzagl and Wefelmeyer's result on their asymptotic distribu- 
tions, and the crucial Lemma [2?T] below, might be useful for proper sequential 
analysis as well. For example, under the assumptions of Theorem 1 1.1 1 but with 
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condition ([T]) omitted, we can generalize (E]) to a computation of the asymp- 



totic distribution of maxJ^+^T^ up to an error o(y/c/n) for k/n 0, by 
using |15|, Proposition 10.3.1] rather than 15|, Corollary 10.3.8] in a modifi- 
cation of the present Proof 



1.3. Examples. In each case below, let a G ]0, 1[ be the level of the tests 
considered. 

1.3.1. The Gauss test. The Gauss test for testing /i < /io based on i.i.d. 
normal Xi, . . . , X„ with unknown mean G M and known standard deviation 
o"o G ]0, oo[ rejects iff 

T. := -$-^(l-a) + ^E^^ > 

^ (To 

Hence Theorem 11.11 is applicable, with Xi ~ N^o.^-g' /o(^) •= ~ f^o)/'^o, 
and vanishing /xi, /i, /2, and Rn, and (IHl) reads 

Here is the elementary proof of ( JTSl) for the simplest case of A; = 1 promised 
immediately before the statement of Theorem ll.lt With Yi := (Xj — yUo)/cro, 
Zn '■= Yl'i=i Yi and z := $"-'^(1 — a), we have 

ttn,! - a = P(^„ > 2; or Z^+i > z) - P(Z„ > z) 



= P(Z„ < Yn+i > Vn + lz - V^Zn) 
= j (1 - ^(Vri + lz- ^/nt))i^{t) dt 

since Z„ and Fn+i are independent and Nq ^^-distributed. Hence, using the 
change of variables t ^ z — we get 

'n(an,i-aj = J ^1 - ^(^{\/n + 1' - y/n')z + t^^(p{z 1=;) dt 

^ r{i-m)^i^)dt 

/■oo 

= (^(2) / tip(t)dt 
Jo 



by dominated convergence with the integrands dominated by the function 
t^ (l-$(t-z_))(^(0). 
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1.3.2. Testing an exponential mean. The usual optimal test for A > Aq 
based on i.i.d. exponential Xi, . . . , X„ with density ]0, oo[ 9 x i— >• Ae"'^^ with 
A G ]0, cx)[ unknown rejects for large values of J2i=i namely iff 

1 " 

:= -FpJ(l-a) + ^5](AoX,-l) > 

v"- i=i 

where P„ denotes the law of the standardization of YJi=i under A = Aq 
and Ff^ the corresponding quantile function. Since P„ admits an Edgeworth 
expansion with remainder o{l/^/r^), see e.g. 13|, p. 174, Theorem 5.22], we 
have 

T„ = -$-i(l-a) + ^5:/o(X,) + 4^ + i?„ 



where /o(x) = XqX— 1, yUi G M depends only on a, and where i?„ is determin- 
istic and o{l/^/r^) for n oo. Hence the assumptions of Theorem 1 1.1 1 are ful- 
filled. With 7„(x) := (r(a))"^x'*-^e-^ we have - a)7„(t) dt = a7a+i(x) 
for a, X G ]0, oo[, by differentiation with respect to x and considering x oo, 
so that 



(£-1)! 



and accordingly ([H]) reads 

/ N h(a) \/2tF ^ /£x^-i 1 I IK \ ,K 



1.3.3. r/ie t-test. The t-test for yU < /io based on i.i.d. normal Xi, . . . , X„ 
with unknown mean /i G M and unknown standard deviation a G ]0,cx3[ 
rejects for n > 2 iff 



T 



-in i n 



with := (Xj — jiQjlo-Q with ctq G ]0,oo[ arbitrary, F„ = ■^YH=iYii and 
Cn denoting the (1 — a)-quantile of the t-distribution with n — 1 degrees of 
freedom. Assuming Xj ~ N^^^ ,^2 from now on, the Yi are standard normal. 
We write := i Y.U and"^^ i_ ^n^^^y, _ y^f = Y^-YI and use 
Cn = + O(^) e.g. from [111, P- 461, (11.75)], = 1 + 0(i) for 
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neN with n>2, and ^/F = 1 + (x - l)/2 + 0{{x - 1)^) for x G [0, oo[, to 
get 

1 " 

1 " 




^ i=i 



- (<^>-^(i - «) + (i + \{Y;i - 1) - ^r! + o((5^ - 1)^)) 

V 1=1 1=1 

where the sequence {Rn) satisfies (171) by Lemma [L2l with p = 1, since ni?„ is a 
hnear combination with bounded coefficients of the four random variables 1, 
^ YJi=iiXi ~ 1)7 "^^n; ~ 1)^) which are uniformly integrable, as may 

be verified by checking that their second moments are bounded. Hence the 
assumptions of Theorem 11.11 are fulfilled, with /o(a;) = (x — /io)/cro, /ii = 0, 
= — $~^(1 — «)(((x — /io)/cro)^ — 1), and /2 = 0, and we get the same 
asymptotic formula (JTSll as in the Gauss case. 



2. Auxiliary results and proofs. In this section we use Pfanzagl and 
Wefelmeyer's |l5l . p. 16] ep-notation: For real-valued random variables X„ on 
probability spaces (f2„,^„,P„) and numbers 5„. > 0, we write 

Xn = %„(5n) {n 00) 

\/e>0 P„(|X„| >£) = o(5„) (n^oo) 

Here n can belong to any index set if "n — 00" is replaced by the specification 
of some appropriate passage to the limit, formally by a filter or a net. In our 
case the index is actually (n. A;) G N^, but P„^fc is for notational convenience 
chosen to be independent of (n, k), say an infinite product measure, so that 
^ becomes e^. The three successively more specialized passages to the 
limit we use are "n —>■ 00" , ^^k/n — > 0", and "fc/n — »• 0, — 00" . 

We begin with a comparison of our versus Pfanzagl and Wefelmeyer's as- 
sumptions on the stochastic expansion ([S]), then state and prove the crucial 
Lemma 12. 1^ and conclude by proving Theorem 11.11 and Lemmas 11.11 and II. 2[ 

2.1. Discussion of the assumptions (E]), ([5]), and Our assumptions on 
the sequence (T„) differ in three respects from those of [15, p. 343, Corollary 
10.3.8, Sn = yu(-P) + Tn/y/ri, the case gi = = 0] used in the proof of 
Theorem 11.11 below. 
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First, to simplify the notation, we have added the normahzing assumption 
E(/o(Xi))2 = 1. 

Second, as already discussed above, we have ([7]) instead of Pfanzagl and 
Wefelmeyer's ''^/nRn = ep{l/^/^y\ that is, (fT2|). 

Third, instead of our f/„ := ^ Z]{j,j)G{i,...,n}^ /2(-^j? -^j) in the stochastic 
expansion of T„, in [15|] we have Vn := ^J2{i,j)e{i,...,npf2{Xi,Xj) and the 
additional assumption E(/2(Xi, Xi))^/^ < oo. Here our version is slightly 
more general, since, under the moment condition just stated, we have Vn = 
Un + l'E,f2{Xl,Xl) + ^/n Rn, whcrc the present i?„ := n"^/^ J27=i "with := 
|(/2(Xj, Xj) — E/2(Xi, Xi)) also satisfies ([7]), as follows via Lemma ITTIl from 
the fact that for p := 3/2 the random variables Yn defined by ( IT3ll are given 
by Yn = y^"_i and hence are uniformly integrable by the Theorem 

of Pyke and Root [16|. Hence, even under our more stringent condition (JTj) 



on the remainders, we may in the expansion from 15 1 simultaneously replace 
Vn by Un and /ii by /xi + iE/2(Xi, Xi). Moreover, [l5|. Proposition 10.3.1 and 
Corollary 10.3.8] remain true with f/„ in place of Vn even if the assumption 
E(/2(Xi, Xi))^/^ < oo is omitted, since the latter is used in 15|] only to 
replace Vn by Un in the proof of [is*. Proposition 10.3.1] in order to prepare for 
the application of the result of Bickel, Gotze and van Zwet Q, Theorem 1.2] 
and Gotze [8|, Theorem 1.14] which refers to [/-statistics rather than V- 
statistics. 

Finally let us note that our non-latticeness assumption in ([5]) is the same 



as the one imposed in [l5j using the confusing term "strongly non-lattice" 



necessary only for multivariate statistics T„, see pj, pp. 207, 221, and 226] 



2.2. The main lemma. The following Lemma [2.11 is the crucial first step 
in our proof of Theorem 11.11 in Subsection 12.31 below. 

Lemma 2.1. Let (T„)„gp^ be a sequence of real-valued random variables 
such that for n G N we have for some constants fiQ, yUi G M, a measurable 
space X , a sequence {Xn)n<m of independent and identically distributed X- 
valued random variables, measurable functions fo, fi : X ^ M. and /2 : X'^ 
M, and a sequence (-R„)„gN of real-valued random variables with (jll), 

(17) E|/o(Xi)|^ < oo, E|/2(Xi,X2)|5+^ < oo for some (5 > 

and Then 
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Proof. Let e > 0. We have for n, e N 
U := L.H.S.dlHD 



^ n+k 

< max 

m=n 



1 



1 



Zl/o(^i)| + max 



+ ^a||-E/i(^0--E/i™ 



n+fc 

+ max 

m=n 



i=l 

m j-l 



n 



i=l 



3/2 



n+k 

+ max 



j=2 i=l 

=: ?7i + f/2 + f/s + f/4 + f/5 

For a G M, the elementary inequahty 

> l-(aVl)x 
apphed to x = k/{n + k) yields 

1 1 



n 



3/2 



i=2 j=l 



(19) 



< 



(xG [0,1[) 
(a V 1) A; 



{n + fc)" n° {n + A;) 

Investigation of f/i: By ffTUl) with a = 1/2, 



< 



(a V 1) A; 



n 



n+fc 



^ {n + k) 

and by Kolmogorov's inequality, see [gI, p. 61] 

, 2 A; 



n + k 



Investigation of [/2: Again by ( |T9l) with a = 1/2, we get 

|/ii|A; 



0) 



Investigation of U^: By (fT9l) with a = 1, we get 



(n — > oo) 



n+k 

max 

m=n 



1 1 n 1 m 

;---)E/iTO + - E AM 



m n 



< 



n" 



i=l 



i=l 

1 n+k 

+ — max 

m=n 



m 



i=n+l 



E 

i=n+l 



f/3,1 + U3,2 
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By Markov's inequality and the L^-law of large numbers, see 0, p. 337], 



^ \U3,l\>Si 



< 



\ n In ^ 



m — > oo 



By Doob's inequality applied to the submartingale fi{Xi)\ : i G 

{0, . . . , k}), see |;6|, p. 247], and recalling our indicator notation (statement) := 
1 or according to whether "statement" is true or false. 



Pf \U3o\ > e 



> evnk 



(20) 



< 



P(m|c|5:A(X, 

i=l 

-\/- e(|^E/i(X.)| ■ (|m|cE/irai > e 



[n ^ oo 



where for the last step, given 5 > 0, we choose according to the L^-law of 
large numbers such that E | Y.i=i fii^i) < S/e ioi k > kg, and then uq such 
that for k < ko and n > uq the expectation in line (l20l) is < 6/e. 
Investigation of f/4: By ( fT9l) with a = 3/2, we get 



n+k 

max 



1 



< 



^3/2 ^3/2 
3A; 



1 n j-1 



j=2 i=l 

n i-1 

j=2 i=l 



1 n+k 

+ ^77:7 max 



3/2 



j=n+l 1=1 
m J — 1 

j=n+l i=l 



2n3/2(n + fc) 
=: f/4,1 + t/4,2 

Letp := (|+5)A2 for some 5 from ([nD. With ci := 2 (|)pE|/2(xi, Xs)]?' < 00, 
Markov's inequality and inequality (1^^ from Lemma 12.21 below applied to 
fij ■■= f2 yield 

o n j-1 

< (-)V/2n-> + A;)-^E|5:E/2(X„X, 



P( |f/4,l| >^\l- 



^2e^ 

< Cikf/^n'^~P{n + k)-P 

fk 
n 



j=2 i=l 



C1I 



l)/2^5/2-p 



< C1I 



+ k)-P 

[by k < n + k and n + k > n] 
(n — >• 00) 
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since p > 4/3. To bound f/4,2, we again use Lemma [2.21 but with n + k in 
place of n and with fy := f2 for j > n and fij := for j < n, to see that 

Mm := E T^M^^^Xj) {me{n + l,...,n + k}) 

j=n+l i=l 

defines a martingal. Hence Doob's inequahty, ( !22l) . C2 := 4e~^E|/2(xi, X2)|^ < 
00, and p > 3/2 yield 

1 n+k 



F(\U^,2\>e\-) < P(^max|M„|>£ 

V \ n J n-^l^ m=n+l 



j=n+l 1=1 

< C2 ■ {ny/k)~^k{n + A;) 

k / 1^ 3_„ , 3^ i_„ 
= C2]l — [k 2 '^^ + k 2 P 

'k / 3 „ A;^ 



/ K / 3 „ /C4 

< C2W- r^2-P + — 



n 

Investigation of f/5: Using (JTj) with t = y/W, we get 



0) 



Ik 



(21) P(|f/5|>2.^/- j < E^[\Rm\>eJ- 



n+k 



-^j:VkF(\R^\>eJ^) 
Vk^n V V m / 



m=n 

A;+ 1 , 1 
o 



k \/n 



n — >• 00 



n 

Combining the results for Ui, . . . ,1/^, we get 



P{\U\>8e^k/n)=o[\l-) 0) 



□ 
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The following lemma, which we have just used above when handling U a, is 
in principle well known, see for example Koroljuk and Borovskich' book |lOl . 
p. 72, Theorem 2.1.3, the case r = c = 2] for the special case where the fij 
are symmetric and independent of (i, j). 

Lemma 2.2. Let Xi, . . . ,X„ be independent X -valued random variables 
and let fij : X"^ ^ M. be measurable with E|/jj(Xj, < oo and with 
E[fij{Xi,X,)\Xi) = Oforl<t<j<n. Then 

m j-l 

Mm := EE/^.(^-^.) (mG{2,...,n}) 

j=2 i=l 

defines a martingale, and for p G [1,2] we have 

n j-l 

(22) E|M„r < 4^^E|/,,(X,,X,)r 

j=2 i=l 

Proof. Clearly {Mm : m G {2, . . . , n}) is a martingale with respect to the 
a-algebras (t(Xi, . . . , and so is {YT=i fiji^i, ^j) - ^ ^ {2^- ■ J-l}) for 
every j. Applying twice the inequality of von Bahr and Esseen [20|, Theorem 2] 
yields 

n j-l p n j-l 

E|M„r < 2j2EY.fi,{X,,Xj) < 2^2^E|/,,(X„X,-)r 

i=l 



i=2 



j=2 i=l 

□ 



2.3. Proof of Theorem Lemma 12.11 combined with the elementary 

inequality | max — max bm \ < max | &m ~ | yields 



(23) max 



m=n 



1 n+k k k k 

max M^i) + \ - ~ ) (~ 



i=n+l 



Let e G ]0, 1]. In this proof, Ci, C2, C3 G ]0, cxd[ and implied constants in 0(. . .)- 
statements do not depend on n, k,e, but may depend on a, the law of Xi, 
and the sequence (T„). Using first f^Hj) and then the independence and sta- 
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tionarity of the sequence (Xi), we get 



(24) 1 - a 



n.k 

= P(maxT„ < 0) 

m=n 



o 



= I nTn<y)dQn,k{y) +o(J- 
for k/n 0, with Qn,k denoting the law of 



1 fc k 

Y„k ■= = max ± £ W - (n, A; G N) 

, M e=o V n 



where 

e 

S, := E/oTO (^eNo 



j=i 



Since the /n(Xj) are i.i.d., we can apply a result of Kac, see [qI, Theorem 4.1] 
and also [l9|, p. 330], to get 

(25) WYn^k = -^Y.l^(S,)+±e\- 

'n TTii ^ n 



Since — l^n.fc = '^^'^\=o{^^St ^ e yk/n) is the maximum of a martingale, 
the usual maximum inequality, see e.g. 0, p. 248], yields 

(26) Er„% < 4E(^-L^,^£^y = 4(1 + 5^)- < cr 



n n 

and hence in particular, by the Chebyshev and Lyapunov inequalities, 

(27) n\YnA > 1) < ci-, \EYnA < V^\ - 

n \ n 

An application of 0, p. 343, Corollary 10.3.8, with S'„ = ix{P)+Tn/Vn, P 
the lawof Xi, /? = 1-a, /i(P) = 0, a(P) = 1, A^"^ = $-i(l-a), g^ = g^ = 0, 
Bo{gi) = Bq{0) = 0, P(/o(-, P)5'i) = 0, and with [/„ in place of Vn according 
to Discussion 12.1] yields 

(28) P(T„ < y) 

= Fn{y) + oi—^) {n ^ oo, locally uniformly in ?/ G M) 
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with 



(29) := $ <^-\l-a)+y 



ay + hy"^ 



(n e N, y G 



where a, 6 G M depend only on P, /o, /i, /2- 

Since the functions P(T„ < ■) and F„ are [0, l]-valued, we get 

(30) / P(T„ < y) dQn,k{y) - I FM dQ^Av) 

< f |P(T„ <y)- F4y)\ dQ^Av) + QnA^ \ [-1> 1]) 



o 



(^) + O(-) (n ^ cx)) [by (EHD and (ET])] 



'A; 

o| 1/- 

n 



Using 



FJO) = 1 - «, F^(0) = ^.($-1(1 -«))■! + 



I^nlloo := sup|F"(?/)| < C2 (n G 



with C2 depending only on a and 6, a Taylor expansion of F„ around zero 
yields 

(31) / FMdQnAv) 

= F„(0) + F;(0)EF„,, + OiKW^EYl,) 

= 1-a + ip{<^-\l-a))(l + -^)EYn,k + 0(- 



k 



using dini) and (I2SD. Combining (0), HMD, (1301) and dSH) yields dE]). 

We have E[Si/\/T)j^ — > l/v^^vT for £ cx3, by the uniform integrability 
of {Sii/\/T)_^ following from E(5'£/-\/F)+ < 1 and by the central limit theo- 
rem, compare [sl, Theorems 25.12 and 27.1]. It follows that '}2^=i |E(S'^)_,_ ~ 
7=7 ELi -jf ~ tItV^ for ^ oo. Hence ^ yields dH]). □ 
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2.4. Proof of Lemma We have 
(32)/i = — ^ ■ (]0,oo[9 a; ^ -) o o (]0, 1[9 a ^ $"^(1 -a) 



2ti ^ if 

Since Mills' ratio 3 x ^ ^i^) = /o°°exp(-xt - t^/2)<lt and the other 
two composition factors in fl32p are strictly decreasing, so is h. Applying the 
well-known asymptotics ^-^(x) ~ ^ for x — > oo and — a) ~ ^J2\o^^^ 

for a ^ to (I32D, we get □ 

2.5. Proof of Lemma ITTB . By assumption lim^^oo sup„>„jj EF„(y„ > y) = 
0, and for t > 1 



□ 

Acknowledgements. Thanks to Peter Hall for some helpful comments 
on a previous version of this paper. 
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